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Abstract. For the past 30 years Exelis Visual Information Solutions has 
been delivering image science tool sand solutions to both research scientists 
and image analysts within the Environment & Natural Resources 
community. I n this paper we present a new capability, the ENVI Services 
Engine, which exposes ENVI processing functionality as RESTful web 
services providing online and on-demand image science Apps to the 
geospatial community. The ENVI Services Engine is interoperable with 
other middleware and servers, adheres to open standards, can support 
multiple clients (web, mobile, desktop) and is configurable to thin-client 
environments, such as the J avaScript. Thus we solved the requirements of 
today's geospatial users expecting online, on-demand access to image 
processing in a client-server enterprise or cloud architecture. 
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1. Introduction 

Geospatial software users are looking for tools to get answers from imagery 
anywhere, anytime. As organizations grow and more users employ image 
analysis in their decision making process, these organizations have a need 
to centrally deploy and manage applications, tools and data. Additionally, 
as users are located in a variety of environments, results need to be 
available on thin clients such as a web browser or native mobile device 
(O'Connor etal. 20 12). 

Desktop software only solutions no longer meet these needs for geospatial 
processing. Therefore, we solved the above in an interoperable, standards- 
based REST (Representational State Transfer) solution. 

The ENVI Services Engine (ESE) is a cloud-based deployment of image 
analysis functionality that integrates into geospatial platforms. The ESE is 



comprised of a RESTful API that allows users access to ENVI's imagery 
exploitation capabilities, as well as the necessary components to publish 
and deploy these consumable web services into any enterprise 
environment. By offering on-line, on-demand image analysis, geospatial 
users have access to information derived from remotely sensed data from 
any I ocati on at any ti me. 

In the current state of development, we do not provide any off-the-shelf 
client application or Software development kit (SDK), leaving it free to work 
with any type of client. 

Section 2 gives a short summary on ENVI , and introduces the ESE, which 
accesses ENVI's tools for image processing and analysis. Section 3 covers 
the development of Apps. Section 4 describes a reference implementation. 
Finally, Section 5 presents the conclusions. 

2. ENVI-Based Services in the Enterprise 

2.1. ENVI - Environment for Visualizing Images 

ENVI solutions combine spectral image processing and image analysis 
technology to get detailed information from geospatial imagery. Data 
gathered from today's satellite and airborne sensors, including 
panchromatic, mu I ti spectral, hyperspectral, radar, thermal, and LiDAR, is 
supported. ENVI ingests, reads, and extracts information from these 
various sources, and can fuse multiple data modalities to exploit the 
strengths of each data type. It works with any size data set and has 
automated tools to prepare big and small geospatial imagery for viewing or 
further analysis. Data preprocessing and analysis includes a comprehensive 
suite of tools for, e.g. atmospheric correction, registration, ortho- 
rectification, filtering, geospatial statistics, topographic modeling, and 
object based feature extraction, etc. (Exelis Visual Information Solutions 
20 Ba). 

ENVI is written in the IDL programming language. This allows users to 
extend or customize ENVI features and functionality to fit both image 
analysis requirements and specific project needs (Exelis Visual I nformation 
Solutions 20 Bb). 

2.2. ENVI Services Engine Overview 

ESE incorporates open source standards, and, as a result, supports 
integration into many different types of systems. By running ENVI or I DL 
algorithms and routines as enterprise services, users can access any of the 
image analysis components they need for data exploitation. Once an ENVI 



or I DL routine is developed, it is quite simple to wrap it as a service and 
deploy it in the engine for consumption. 

ESE runs these algorithms through a standard HTTP RESTful interface, 
al I owi ng users to provi de basi c user i nterf aces to compl ex anal ysi s tasks vi a 
lightweight client, (see Figure 1). In particular, it is based on ESRI's Ge- 
oServices REST specification (Esri 2010). The ESE implements a 
superset of ESRI 's specification wherever it makes sense for I DL and ENVI 
processing (Exel is Visual Information Solutions 20 Be). 

Results are returned to the client via standard HTTP mechanisms. They can 
be saved and displayed in a variety of clients, including online, desktop, and 
mobile clients, depending on the user's implementation. These image 
analysis applications and components can be integrated into a cloud 
environment, independent of any existing middleware configuration (see 
Figure 1). The ESE is therefore a flexible and easy to use framework that 
f uncti ons withi n the user's existi ng i nf rastructure. 

As well as offering on-demand, online access to ENVI functionality, the ESE 
can be used to develop and expose unique analytics, allowing organizations 
to create their own enterprise image analysis workflows. Using existing 
ENVI functionality in a cloud environment will help to save time and 
resources, as the user can develop an algorithm once and deploy it to 
multiple locations. Additionally, the user can release new applications and 
functionality as mission needs change and evolve. 
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Figure L ENVI Services Engine conceptual rendering (Exelis Visual Information 
Solutions 2012). ESE runs eg. ENVI and IDL routines through a standard HTTP 
RESTful interface. Data requests are handled via WCS or WPS calls. ESE is called 
by a web client or mobile app via a middleware component. 



One of the largest benefits of deploying image analytics in the cloud is the 
ability to run complex, resource- intensive analysis on extremely large 
datasets from thin or mobile clients. By having both the data and analysis 
components on the web, lightweight applications can be used to call the 
analysis functions, making the analysis workflow more efficient for users 
and moving image exploitation closer to the end user. 

2.3. Architecture 

The ESE application consists of one "master" process and one or more 
"worker" processes (see Figure 2). 

Master and 
Node Leader 




worker 



worker 



worker 



Node 
Leader 



worker 



worker 



worker 



DFS or NFS 



Figure 2. ENVI Services Engine architecture: 
"master" process and associated "worker" processes. 



Processing requests are passed to the Services Engine via HTTP REST calls. 
The master contains an embedded web server. The master's job is to 
manage requests and jobs for worker processes. Worker processes contain 
an IDL interpreter and do the actual IDL and ENVI processing. When 
workers complete a job, they notify the master of the results and the master 
returns those results to the client (Exelis Visual Information Solutions 
20 Be). 

ESE runs on 64-bit Linux and Windows as either a daemon or a standard 
application (launched manually). Security must be provided by the user by 
way of file and execution permissions, proxies, firewalls, etc. (Exelis Visual 
I nf ormati on Sol uti ons 20 13c) . 



An ESE process assumes the role of master if it is the first instance of the 
process that is started up on the machine that is designated the master 



machine. On any other machine in the cluster, the first instance is run as a 
node leader. A node leader will launch and monitor a configurable number 
of worker processes. This number can be specified by a configuration file 
but typically defaults to the number of CPUs on the system. Node leaders, 
including the master, will relaunch workers that have exited (Exelis Visual 
I nf ormati on Sol uti ons 20 Be) . 

2.4. Scalability and Load Balancing 

The important need of scalability is supported by the ability to scale and 
load balance because it implements a REST architecture and is designed to 
run on a cluster. As requests arrive from any number of clients, the master 
process' web server will accept and route the request. If the request is to 
perform a task, then the master will give the request to one of its worker 
processes. Worker processes can run on any machine in the ESE's cluster. 
The cluster is a collection of machines tied to one particular master 
machine. Namely, a machine is part of the cluster if it is running an 
instance of the ESE executable and that executable is wi red to communicate 
with the same master as other machi nes on the cl uster. The master machi ne 
is specified by a configuration file (Exelis Visual Information Solutions 
20 Be). 



3. Developing Apps 

3.1. Access Image Analysis Functionality through Apps 

ESE is designed for such enterprise web services and can be configured to 
work with multiple types of thin-and-thick clients including web browsers, 
mobile devices (Android, iOS) and workstation applications such as EN VI 
or ArcGIS (seeFigure3) (ExelisVisual Information Solutions 2012). 

The advantage of this approach is that analysts can access specific image 
science algorithms, tools and configured workflows through discrete Apps 
that are easy to update and mai ntai n . 

3.2. Benefits for Developers Creating Apps 

The benefits for the developers creating Apps to use with the ESE include 
(ExelisVisual Information Solutions 2012): 

• Accessto 100+different formats and modalities of imaging data. 

• Ability to exploit multi-source image data using proven analytic meth- 
ods such as Target Detection, Object-Based Feature Extraction, Change 
Detection. 



• Ability to deliver derived products in easily consumable formats (.shp, 
kml, NITF, etc.). 

• Access to analytic methods that have been widely used in the scientific 
community for decades. 

• Ability to fuse multiple sources of information, resulting in higher con- 
fidence in derived products. 

• Extensibility allows for quick insertion of capabilities to support new 
and emergi ng modal iti es and/ or analyti c approaches. 




Figure 3. An interactive Line-Of- Sight App, launched from Native Android Client 
(Exelis Visual I nformation Solutions 2012). (a) The user locates an AOI , (b) draws 
an interactive circle to indicate parameters, (c) the middleware passes the location 
and AOI to the service, (d) the high-level service finds the appropriate data in the 
catalogue and constructs the ESE call, (e) the ESE runs and returns the vector re- 
sult showing the line of sight, (f) the vector result is passed through the middleware 
to the client, (g) the client renders the result in the appropriate geographic location 
in the interface. 



4. A Reference Application 

In an effort to provide examples of how the ESE can be used, Exelis VIS 
created a reference implementation that redeploys several pieces of existing 
ENVI code as Apps. These include (O'Connor etal. 2012): 



• Anomaly Detection for detection of spurious material in a largeimage. 

• Pan Sharpening for enhancing multispectral data with high resolution 
panchromati c i imagery. 

• Vegetation Delineation for identifying vegetation presence and level of 
vigor. 

• Lineof Sight to create a viewshed usingterrain data (seeFigure3). 

• Spectral I dentification to show using a spectral library to classify mate- 
rials in a hyperspectral dataset. 

This implementation envisions a web client or mobile app calling the ESE 
via a middleware component such as MapServer, GeoServer, or some other 
development environment and employs a web based GUI and/ or a mobile 
app for Androi d or i Phone as an access mechani sm (O'Connor et al . 2012) . 

Thin and mobile clients are used to discover data using a cataloguing 
specification such as Web Catalog Service (WCS) and to make Open 
Geospatial Consortium (OGC)-compliant analysis requests via Web 
Processing Service (WPS) calls to the EN VI Services Engine via the 
middleware (see Figure 4) (O'Connor etal. 2012). 
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Figure 4. Accessing a data catalogue with a J avaScript interface (O'Connor et al. 
2012). 



One use case example could be looking at the Landsat archival data with the 
vegetation delineation tool. For a region or a specific scene, this ESE 
implementation would facilitate in discovering imagery, identifying 
vegetation and analyzing change over time. Results could include an 
animation, a profile of vegetation change over time, or specific points 
correlated to ground truth measurements. These results could be delivered 
to web, mobileor a desktop clients (O'Connor etal. 2012). 



5. Conclusion 

The ENVI Services Engine (ESE) provides the community with a flexible 
and easy-to-use framework for creating and using image science Apps. 
Tasks such as detecting target signatures from hyperspectral imagery or 
calculating a Line of Sight (LOS) from LIDAR data are simple to execute 
and easy to share. The power comes from exposing all of ENVIs image 
processing algorithms and tools as RESTful web services and using EN- 
VI/ 1 DL, J ava or other development languages/ tools to create Apps for im- 
age science tasks such as orthorectifi cation, classification, etc.. Benefits of 
theESE approach include (Exel is Visual Information Solutions 2012): 

• The flexibility to integrate into any architecture that can make http calls. 

• Delivers an online, on-demand approach to data analytics. 

• Takes advantage of open standards allowing for integration with other 
Apps. 

• Allows experts to compile and expose their workflows and tradecraft, 
enabling end users to create their own tailored GEOProcessing 
products. 

• M i ni mi zes desktop software I i censi ng costs. 

• Emphasizes the use of server side hardware by offloading processing 
tasks previously performed at the desktop level . 

The way imagery data is being stored and analyzed is changing. ENVI and 
IDL have long been tools used in Earth science communities. TheESE helps 
scientific data users transition to the cloud while still being able to use 
legacy code and algorithms (O'Connor etal. 2012). 

The ability to host and disseminate data and complex functionality within 
the cloud will lead to wider enterprise- wide hosting and dissemination of 
earth science data in the future. The work behind ESE is aimed at making 
this concept a reality. More people being able to access and process 
scientific data means more discoveries, more collaboration, and more 
progress, e. g. toward future environmental challenges (O'Connor et al. 
2012). 
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